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INFOJWATICm  THEOKY  IH  HUNGARY 


In  Hungary  research  in  infoxmation  theory  and  statistical 
CGBununication  theory  is  carried  out  principally  at  four 
institutions:  Hie  Telecommunications  Research  Institute 
(TKI)  (called  "Taki")  Gabor  Aron  (it  65  just  west  of  Torokvesz  (it> 
the  Coomunication  Electronics  Institute  of  the  Technical 
University  of  Budapest  at  Stoczek  utca  2 (tel.  450-300); 
the  Fine  Nechanic2tl  Works  (FMV)  at  Feher  (it  10  (tel.  836-775); 
and  the  Mathematical  Institute  of  the  Hungarian  Academy 
of  Sciences  (Magyar  Tudom^nyos  Akad&ia  Matematlkai  Kutato 
Int^zete) , Rel[ltanoda  utca  13-15  (tel.  182-875). 

Since  the  time  of  Josef  Jauch's  visit  a decade  ago 
to  this  last  Institute  (ONKL-R-56-67) , living  conditions 
in  Hungeury  have  in^roved  considerably,  but  it  is  still  a 
largely  agrarian  country,  2md  there  is  still  a secret  if 
much  less  active  police  force.  Hungariems  nonetheless  are 
enjoying  much  more  contact  with  the  West  than  previously, 
both  through  visits  from  abroad  emd  visits  to  other  countries. 

Except  for  pocket  calculators  (whose  Importation  is 
forbidden  in  order  to  protect  a domestic  computer  industry 
that  does  not  yet  appear  to  be  providing  calculators) , the 
shops  in  Budapest  seem  well  stocked,  with  domestic  goods 
at  prices  conqparable  with  those  edsroad  except  that  food 
is  relatively  ineiqpensive.  These  goods  are  exported  at  a 
special  rate  of  exchange,  however,  that  cuts  their  prices 
nearly  in  h£^.f  (35  forints/dollar  instead  of  20),  leaving 

Hungary  in  a more  favorable  position  in  regeurd  to  foreign 
excheuige  than  other  countries  of  the  Soviet  bloc.  Wages 
have  risen  to  the  point  where  manual  l2dx>rers  now  receive 
3000  forints/month,  graduate  engineers  5000,  emd  full  professors 
8000  with  the  possibility  of  considerably  increasing  this 
last  figure  through  additional  work.  Still  the  wife  is 
rare  %dio  stays  home  to  look  after  her  small  children,  even  when 
her  husbemd  has  a respected  position. 

Magy£u:  Tudom&iyos  Akadenia  Matematikai  Kutato  Intezete 


At  the  Mathematical  Institute  wages  tend  to  be  lower 
than  elsewhere  (e.g.,  only  4500  forints/month  for  a senior 
rese£urch  fellow,  which  can  be  augmented  by  extra  activities) 
to  offset  the  attractiveness  of  the  working  conditions. 

The  Institute's  en^loyees  are  free  to  pursue  %diatever  lines 
of  research  appeal  to  them.  This  freedom  was  part  of  the 
first  director  Alfred  Rinyi's  plam  in  founding  the  Institute 
in  1950,  and  after  his  death  in  1971  his  successor  L&zlo 
Fejes  T6th  has  maintained  this  policy.  (In  Hungetrian  s 
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is  pronounced  sh,  and  sz  is  pronounced  88  as  in  German.) 

In  addition  to  heading  the  Institute,  Fejes  Toth  [famous 
for  his  yellow  Springer  book  Lagerungen  in  der  Ebenej  auf 
der  Kugetf  und  im  Ram  (Packing  in  the  Plane,  on  the  Sphere, 
and  in  Space)]  also  heads  its  Geometry  Group.  His  son  G^or 
works  in  the  field  of  geometric  inequalities,  too,  laut  he 
is  found  in  the  Information  Theory  Group  in  ccanpliance  with 
an  antinepotism  rule.  The  latter  Group,  headed  by  Dr.  Imre 
Csiszar  (the  accents  over  Hungarian  vowels  indicate  their 
sounds;  the  stress  invariably  falls  on  the  first  syllable) , 
is  one  of  the  three  "Stochastic  Groups,"  the  other  two  being 
Statistics,  headed  by  Dr.  Istv^  Vincze,  and  Probcibility, 
led  by  Pal  Revesz.  The  other  six  Groups  are;  Combinatorics, 
Algebra,  Differential  Equations,  Ccxnplex  Analysis,  the  History 
of  Mathematics,  and  the  Teaching  of  Mathematics.  Each 
Group  includes  about  seven  mathematicieuis. 

The  Institute  receives  about  seventy  visitors  from 
abroad  each  year  for  periods  ranging  between  a week  and 
several  months  with  the  aid  of  the  Janos  Bolyai  Mathematical 
Society  (cf,  ESN  31-6:229).  The  Society  gets  its  funding 
from  the  sale  of  publications  such  as  the  proceedings 
of  the  1975  Colloquium  on  Information  Theory  held  25-30 
August  in  Keszthely,  Hungary.  This  volxime  of  650  pages, 
edited  by  Imre  Csisz^  and  Peter  Elias  (MIT) , contains  41 
papers  presented  at  the  Colloquium  (excluding  those  destined 
for  publication  elsewhere),  a quarter  being  by  Hungarian 
authors.  It  is  distributed  by  the  North-Holland  Publishing 
Company  in  Amsterdam  and  London,  and  its  full  table  of  contents 
appears  on  pages  6-7  of  the  December  1976  Nei}8 tetter  of 
the  IEEE  Information  Theory  Group. 

In  addition  to  providing  a source  of  income  and  much 
needed  foreign  c\irrency,  publications  serve  as  a medium 
for  bcirter  to  obtain  foreign  journals  and  books  without 
having  to  apply  for  the  precious  foreign  exchange  that  would 
otherwise  be  required.  Thus,  in  the  field  of  mathematics 
cU.one,  not  counting  those  in  Hungarian,  at  least  seven 
journals  eire  published  in  Hungary,  a country  of  ten  million 
people . 


For  such  a small  country  Hungary  has  certainly  produced 
a very  impressive  nixnber  of  outstanding  mathematicieuis, 
and  one  is  offered  a variety  of  explanations.  One  of 
these  credits  Rolamd  Eotvos,  Minister  of  Education  late 
in  the  nineteenth  century,  with  having  established  a very 
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good  system  for  education  in  science.  Another  attributes 
Hungarian  preeminence  to  mathematical  competitions  in  high 
school  that  began  early  in  the  twentieth  century  rather 
than  to  any  unusual  aspects  of  instruction;  once  identified, 
the  superior  students  received  individual  attention  from 
their  teachers.  Finally  a third  explanation  notes  that, 
on  account  of  the  lack  of  industrialization,  Hungary  could 
offer  few  jobs  to  its  scientific  graduates,  cuid  hence  meiny 
have  had  to  pursue  their  careers  abroad,  the  best  of  them 
finding  positions  most  easily.  This  explanation  is  sometimes 
augmented  by  observing  that  Hungary  imposed  cjuotas  on  the 
nunber  of  Jews  allowed  into  medical  schools,  thus  diverting 
some  into  a second,  less  highly  regarded  choice  and  thereby 
increasing  the  supply  of  mathematical  talent.  Perhaps  the 
truth  is  a combination  of  all  of  these  explanations  and 
others . 

Information  Theory  Group.  Information  Theory  was  . 

first  taught  in  Hungary  by  Renyi,  who  is  well  known  for 

his  generalization  of  Shannon's  entropy.  Later  the  information-  ] 

theory  course  at  the  Eotvos  Lor^d  Tudomanyegyetem  (Roland  j 

Eotvos  University  of  Science)  in  Budapest  was  taken  over  i 

by  Csisz^,  \dio  retains  a half-time  appointment  there  (like  j 

sane  of  his  colleagues)  while  working  at  the  Mathematical  j 

Institute.  It  was  through  this  course  that  Renyi  got  to  j 

know  Csisz«  and  induced  him  to  join  the  Institute,  and 

CsiszSr,  in  turn,  brought  in  Janos  Korner.  [Korner's  thesis,  | 

"A  Property  of  Conditional  Entropy,"  appears  in  Studia  Soi.  ' 

Math.  Hung.  6,  355-359  (1971).]  i 

Csiszar  and  Korner  have,  in  fact,  recently  completed  | 

the  first  of  two  volumes  on  information  theory  a la  Shannon,  ! 

exploiting  the  power  of  "typical  sequences"  in  obtaining  ] 

exponential  error  boxonds,  etc.  Volume  I,  dealing  with  the 
discrete  case,  is  to  be  published  by  the  Academic  Press  | 

early  in  1978;  Volume  II  (on  the  continuous  case)  will  appear  j 

at  a much  later  date.  This  work  is  written  in  English  in  | 

order  to  reach  the  largest  possible  audience,  and  its  publication  j 

in  the  West  cam  be  credited  to  Eugene  Lukacs,  the  recently  I 

retired  famous  probabilist  who  at  one  time  headed  the  Statistics  ] 

Branch  of  ONR  and  who  has  been  am  editor  for  the  Acadonic  j 

Press.  Csisze^r,  incidentally,  has  been  elected  to  the  Board  \ 

of  Governors  of  the  IEEE  Information  Theory  Group.  With  ] 

the  aid  of  finamcial  support  from  IBM,  he  amd  Korner  (and  j 

perhaps  K.  Marton  and  P.  Gees,  as  well)  went  to  Ithaca, 

New  York,  to  attend  the  1977  IEEE  International  Symposium 

on  Information  Theory.  Csiszar  also  attended  the  1975  j 
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Syn^osium  in  Sweden^ 

j The  others  in  the  Information  Theory  Group  of  the 

Mathematical  Institute  include  J6zsef  Beck,  Jozsef  Fritz, 

Katalin  (Catherine)  Marton,  and  Tiber  Nemetz.  (In  Hungarian 
the  family  name  always  comes  first,  but  I have  given  it 
last  except  in  the  names  of  streets  and  the  Hungariem  names 
of  institutions,  etc.)  Miss  Marton  is  a coauthor,  along 
with  Csiszir  and  Korner,  of  the  paper  "A  New  Look  at  Exponential 
Error  Bounds  for  Memory less  Channels,"  dealing  with  universal 
codes,  which  was  presented  at  the  1977  Cornell  Information 
Theory  Symposium.  [These  three  are  also  collaborating  on 
: multiuser  channels  and  correlated  sources;  see  "General 

■ Broadcast  Channels  with  Degraded  Message  Sets,"  IEEE  Trans, 

i Information  Theory  IT-23 , 6-64  (Jan.  1977).]  The  other 

^ paper  presented  there  was  "Reliability  Function  for  a Discrete 

; Memoryless  Channel  at  Rates  ediove  Capacity,"  by  Korner, 

> Nemetz  is  studying  the  applications  of  information 

theory  to  statistics  (a  topic  on  which  Csiszir  and  others 

' formerly  worked) , bounding  error  probabilities  in  terms 

i of  Information  measures  and  their  generalizations  (such 

[ as  /-divergences,  where  -cc  log  x is  replaced  by  an  arbitrary 

i convex  function,  as  introduced  by  Csiszar  in  1963),  which 

describe  the  dissimilcirity  of  statistical  hypotheses.  In 
this  work  Nemetz  has  the  collaboration  of  L.  Gyorfi  of 
the  Teleconmunication  Electronics  Institute,  who  has  also 
investigated  the  nonpeurametric  estimation  of  the  posterior 
probabilities  of  single  statistical  hypotheses.  In  addition, 

Nemetz  has  worked,  on  optimum  source  coding  and  on  the  determination 
of  the  entropy  rate  of  printed  Hungarian,  making  use  of 
his  own  inq^rovements  upon  the  method  described  in  Shannon's 
1951  BSTJ  paper.  These  in®>rovements  aim  at  overcoming  the 
effects  of  the  high-school-student  guessers'  tiring  after 
100  letters  and  at  avoiding  the  entropy-rate  underestimation 
that  would  result  from  considering  only  the  record  of  the 
best  of  the  guessers  for  each  passage,  which  may  represent 
only  a statistical  fluctuation. 

Fritz  works  on  statistical  physics  and  on  random 
fields.  He  is  concerned  with  finding  out  vdiy,  for  example, 

> the  entropy  is  maximized  by  the  Gibbs  distribution  of  states, 

thus  extending  the  work  of  Rinyi  on  Maurkov  chains  and  the 
work  of  Linnik. 

Beck  is  young  and  has  been  at  the  Institute  only  two 
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years,  devoting  his  attention  to  combinatorics  and  graph 
theory.  In  addition,  for  a meraoryless  channel  with  an  abstract 
alphabet  (of  infinite  size) , Beck  heks  obtained  a lower  bound 
for  the  error  probability  when  transmitting  above  the  channel 
capacity.  He  has  gener£d.ized  Stein's  lemma  on  hypothesis 
testing,  by  which  the  Kullback-Leibler  divergence  gives 
the  exponent  of  the  error  probability,  and  he  has  shown 
this  to  be  independent  of  tlie  distribution. 

Several  Mathematical  Institute  people  in  other  Groups 
occasionally  devote  their  attention  to  information-theoretical 
problems.  One  of  these  is  Peter  Gacs,  vdio  works  on  complexity 
theory.  Another  is  Gabor  Tusnady,  of  the  Statistics  Group, 
vdio  collaborated  scxne  time  ago  with  Csisz^  and  Gyula  Katona 
of  the  Combinatorics  Group  on  "Information  Sources  with 
Different  Cost  Scales  and  the  Principle  of  Conservation 
of  Entropy"  IZeitadhrift  fur  Wahrsoheinliohkeitstheorie 
und  veruandte  Gebiete  1£  185-222  (1969)] . In  collaboration 
with  Nemetz,  Katona  published  "Huffman  Codes  euid  Self -Information" 
in  the  May  1976  IEEE  Trccnsaotions  on  Information  Theory, 
showing  that  the  code  length  for  a symbol  of  probability 
p « 1 does  not  exceed  1.44  log2  P~* • Katona,  »dio  got  his 
PhD  at  the  Rolemd  Eotvos  University  of  Science  in  1969, 
had  earlier  been  a research  fellow  at  the  Teleccoinunications 
Research  Institute,  and  he  spent  a semester  at  Chapel  Hill, 

North  Carolina,  in  1969.  In  1975  he  was  a visiting  professor 
at  Gottingen,  West  Germany. 

It  thus  seems  that  in  recent  years  Hungary  has  been 
reestablishing  contact  with  the  West.  Indeed,  among  the 
honorary  members  of  the  Hungari2m  Academy  of  Sciences'  Section 
on  Mathematical  and  Physical  Sciences  are  G.  Polya  cuid  G. 

Szeg^  of  Stanford  University  and  D.  Gabor  of  Imperial  College, 
London.  Another  sort  of  cross-fertilization  is  missing, 
however,  in  the  modus  operemdi  of  the  Mathematical  Institute, 
as  all  those  in  the  Information  Theory  Group  are  mathematici2Uis 
by  training,  euid  there  are  no  engineers  to  introduce  a practical 
point  of  view,  thoiigh  informal  contacts  exist  with  engineers 
located  elseidiere. 

Much  good  work  has  nevertheless  been  done  at  the  Institute, 
as  mentioned  above.  Another  example  is  "Source  Coding  with 
Side  Information  and  a Converse  for  Degraded  Broadcast  Channels," 
by  R.F.  Ahlswede  (formerly  Ohio  State  Unlv.  and  now  at  the 
University  of  Gottingen)  amd  Komer  {IEEE  Trane,  Inform, 

Theory f lT-21.,  629-637,  Nov.  1975).  In  addition  to  the 
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collaboration  of  Prof,  Giuseppe  Longo  (Dniv.  of  Triestei 
ESN  31-6:229}  with  Komer  and  Csisz&r,  it  is  i*orth%fhile 
to  mention  Komer 's  52-page  paper  "Some  Methods  in  Multi- 
User  Communicationt  A Tutorial  Survey,"  which  was  presented 
as  p^u:t  of  the  1975  sumner  course  on  "Infoznation  Theory: 

New  Trends  and  Open  Problems"  orgcuiized  in  Udine,  Italy, 
by  Iiongo.  The  proceedings  of  the  course  have  been  published 
by  the  Springer-Verlag.  This  paper  includes  43  references, 

13  being  HungeuricU)  work  and  the  great  majority  of  the  others 
American. 

TO  indicate  the  range  of  Csisziur's  interests,  a few 
of  his  papers  of  the  Ictst  several  years  may  be  mentioned. 

"A  Class  of  Measures  of  Infozmativity  of  C%>servation  Channels," 
[Periodica  Mathematiaa  Hungarioa  £,  191-213  (1972)1  making 
use  of  /-divergences,  was  written  \diile  Csiszar  vas  a visiting 
professcr  at  the  Catholic  University  of  America.  "On  the 
Capacity  of  Noisy  Channels  with  Arbitrary  Signal  Costs" 
speared  in  Prob terns  of  Control  and  Infomation  Theory 
283-304  (1973),  continuing  the  work  mentioned  earlier  by 
Csisz&,  Katona,  euid  Tusn^y,  and  including  the  effects 
of  feedback:  this  journal  is  published  jointly  by  the  USSR 
cuid  Hungaricui  Acadmnies  of  Sciences.  The  Mathematical  Institute's 
qucurterly  Studia  Soientiarum  Matkematioarum  Bungarioa  9_ 

(1974),  57-71,  published  Csisz&^'s  paper  "On  an  Extremum 
Prc^lem  of  Information  Theory,"  generalizing  some  finite- 
alphabet  source-coding  results  to  the  case  of  an  abstract 
(infinite)  alphabet  and  thus  covering  continuous  sources, 
tdiere  the  "alphabet"  is  a function  space.  In  "J-Divergence 
Geometry  of  Probability  Distributions  md  Minimization  Problems" 
Ii4nnaZs  of  Probability  3_  (1975) , 146-158]  he  minimized  the 
Hullback-Leibler  divergence  of  a probability  distribution 
under  linear  constraints  (i.e.,  with  given  marginals  or 
given  generalized  moments)  without  the  use  of  Lagrange  multipliers. 

With  Balram  S.  Rajpit  (Univ.  of  Tennessee)  CsiszKr 
published  "A  Convergence-of -Types  Theorem  for  Probability 
Measures  on  Topological  Vectcr  Spaces  with  Applications 
to  Stable  Laws"  [Z,  WdhradheinlioTikeitstheorie  vena,  Gebiete  36, 

1-7  (1976)1  , amd  with  Komer  he  wrote  "Source  Networks  with 
Unauthorized  Users*  y,  Cmbinatoxnos,  Information  and  System 
Sciences  25-40  (1976)1 , fdiich  considers  sepaurate  coding 
of  the  output  of  each  cf  two  correlated  sources.  One  source 
is  treated  as  a "helper,"  and  its  coded  form  is  made  available 
to  the  destination  in  order  to  reduce  the  information  rate 
required  for  coding  the  other  source.  The  authors  found 
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that  (regardless  of  the  coding  of  the  helper)  the  latter 
rate  is  independent  of  whether  the  user  knows  the  coding 
of  the  helper  or  he  does  not  (his  use  of  the  helper  is 
"unauthorized") j however,  the  coding  required  for  the  other 
source  is  more  coiiq>llcated  in  that  case.  Among  the  references 
cited  in  this  paper  is  "Broadcast  Channel  with  Confidential 
Hessages,"  vAilch  the  same  authors  have  submitted  to  the 
IEEE  Tranaaationa  on  Infomation  Theory,  dealing  with  the 
transmission  of  messages  to  both  destinations  amd  to  each, 
with  each  left  entirely  unenlightened  concerning  the  confidential 
message  sent  to  the  other. 

Statistics  Group.  Vincze,  head  of  the  Statistics 
Group  of  the  Mathematical  Institute,  is  also  a part-time 
professor  at  the  University.  In  Hungary  the  universities 
awaurd  a diploma  aifter  five  years  of  study,  plus  a thesis 
and  examination,  amd  they  also  offer  a doctorate  (the  "can- 
didate" degree) . But  there  is  a still  higher  advanced 
degree,  e.g.,  doctor  of  mathematical  sciences  (DMS) , that 
is  conferred  later  aifter  seme  years  of  research  amd  the 
submission  of  a dissertation  to  am  institution  affiliated 
with  the  Academy  of  Sciences.  Corresponding  members  of 
the  Academy  atre  selected  from  among  these  higher  doctorates, 
of  which  Hungaury  ham  about  100  in  mathematical  sciences 
am  well  am  several  hundred  camdidates  (PhD's)  in  this  field. 
Vincze  began  his  career  with  the  geometry  of  curves,  moving 
then  to  applied  statistics,  amd  his  1969  DMS  dissertation 
dead.t  with  order  statistics.  In  1971  he  published  a book 
in  Germam  on  statistics  with  industrial  applications,  and 
in  1974,  along  with  K^roly  Sarkadi  (a  member  of  his  Group) , 
he  published  Mathematioal  Methods  of  Statistical  Quality 
Control  through  the  Academic  Press. 

Other  members  of  his  Group  are  Peter  Major,  Gl[bor 
Sz^kely,  Endre  Csaki,  Gl^bor  Tusnady,  and  either  Antonia 
L.  Foldes  or  Lfdia  Sz.  Ret^L — ^two  ladies  working  together 
although  one  of  them  is  in  the  Probability  Group.  Csiki 
has  published  "An  Investigation  of  the  Empirical  Distribution 
Function"  in  Hungauriam  (with  109  references)  in  Osztely 
l^zleminyi  23,  239-327,  (1977)  amd  IMsnlidy  has  recently 
written  "Maximum-Likelihood  Fitting  of  Multifactorial  Threshold 
Models”  along  with  L.  Telegdi  of  the  Computer  amd  Automation 
Institute  of  the  Hungarian  Academy  of  Sciences  in  Budapest. 

The  analysis  of  the  data  for  a common  isolated  congenital 
malformation  in  Hungaury  led  to  this  paper's  modification 
of  the  Gauss  additive  multifactorial  threshold  model,  %fhich 
is  formulated  in  terms  of  the  covarlamce  matrix  calculated 
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by  the  method  of  R.A.  Fisher  and  C.  Smith. 

Vincze  has  taught  in  Bahia  Blanca,  Argentina,  in 
Magdeburg,  East  Germany,  and  in  China  in  1959  during  the 
Sino-Soviet  entente.  In  addition  to  his  many  statistical 
papers,  he  has  published  several  in  the  field  of  information 
theory.  At  the  1959  Prague  Conference  on  Information  Theory 
and  Statistical  Decision  Theory  he  presented  "An  Interpretation 
of  the  [Kullback-Leibler]  J-Divergence  of  Information 
Theory,"  and  in  1967  "Some  Questions  Concerning  the  Probabilistic 
Concept  of  Information"  appeared  in  IMS  and  AMS  Selected 
Translations  in  Mathematical  Statistics  and  Probability 
(vol.  5) . At  the  1967  Debrecen  (Hungary)  Colloquium  on 
Information  Theory  (pp.  503-509)  he  presented  a paper  "On 
the  Information-Theoretical  Foundation  of  Mathematical  Statistics" 
extending  Renyi ' s error-probability  bounds  to  the  case  of 
a continuous  distribution  by  dividing  the  domain  of  the 
estimated  parameter  into  a set  of  intervals.  Finally,  his 
paper  at  the  1972  European  Meeting  of  Statisticians  in  Budapest 
(pp.  869-893)  was  "On  the  Maximum  Probability  Principle 
in  Statistical  Physics,"  dealing  with  the  extension  to  con- 
tinuous distributions  of  results  of  Planck,  Boltzmann,  et 
al.  By  maximizing  a pseudoprobability  instead  of  the  entropy 
as  Jaynes  did,  he  obtained  modified  forms  of  Bose-Einstein 
and  Fermi-Dirac  distributions. 

Technical  University  of  Budapest 

With  1700  faculty  members  and  well  over  10,000  students, 
the  Budapest!  Muszaki  Egyetem  is  by  far  the  largest  institution 
of  university  standing  in  Hungary.  Its  Faculty  of  Electrical 
Engineering  has  a staff  exceeding  400  and  a student  body 
of  over  3000,  who  are  spread  among  a variety  of  entities. 

Each  student  is  enrolled  in  one  of  four  Divisions:  Heavy 
Current,  Electrical  Instrumentation,  Electronic  Technology, 
or  Telecommunication;  while  the  faculty  is  grouped  in 
a different  manner,  viz.,  into  two  Institutes  (Heavy-Current 
Engineering  and  Comnunication  Electronics)  plus  eight 
Chairs:  Electromagnetic  Theory  (Gy.  Fodor),  Microwave 
Techniques  (L.  Pasztomiczky) , Electronic  Devices  (I. 

Valko) , Electronic  Engineering  (I.  Nagy),  Automation  (F. 

Csaki,  recently  deceased).  Process  Control  (A.  Frigyes) , 

Electrical  Instruments  (L.  Schnell) , and  Mathematics  (T. 

Frey) . Each  Faculty  has  its  own  Chair  of  Mathematics. 

Ccminunication  Electronics  Institute.  Professor  Sandor 
Csibi  heads  the  Institute  for  Coirmunication  Electronics, 
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which  consists  of  six  Departments:  Computers,  Circuits, 
Broadcasting,  Telephone  Exchanges,  Wire  Transmission  and 
Data  Processing,  and  Acoustics.  Within  the  Division  of 
Telecoirmunications,  on  the  other  hand,  the  students  receive 
instruction  from  five  Branches:  Computers  (mainly  hardware). 
Broadcasting,  Wired  Teleconmunication  (including  data 
teleprocessing).  Microwave  Techniques,  and  Semiconductor 
Devices  and  Microelectronics.  Approximately  200  students 
of  teleconmunication  enter  the  five-year  diploma  program 
each  year. 

Until  recently  Csibi  had  worked  at  the  Teleccnranunication 
Research  Institute  (TKI) , which  is  concerned  primarily  with 
the  development  of  microwave  telephone  relay  system  designs 
and  prototypes.  In  addition,  Csibi  worked  there  on  autcmatic 
pattern  recognition  for  abnormalities  in  electroencephalograms, 
and  he  brought  this  interest  as  well  as  some  of  the  TKI 
personnel  along  to  the  Institute  for  Communication  Electronics. 

One  of  Csibi 's  papers  concerns  "Learning  under  Com- 
putational Constraints  from  Weakly  Dependent  Samples" 

[Problems  of  Control  and  Information  Theory  £,  3-21  (1975)]. 

The  sequence  of  samples  is  assumed  to  be  Markov  of  order  m, 
and  consistent  estimates  of  classification  are  nevertheless 
obtained.  Csibi  presented  further  work  along  this  line 
at  the  1975  Colloquium  on  Topics  in  Information  Theory  (pp. 
143-153)  held  in  Keszthely,  Hungary,  showing  that,  for  indicators, 
the  best  approximation  in  the  mean-squared-error  sense  also 
minimizes  the  probability  of  misclassification.  Unfortunately 
my  visit  with  Csibi  turned  out  to  be  too  short  to  permit 
me  to  learn  of  any  of  his  more  recent  work,  but  there 
is  also  the  possibility  of  some  reluctance  to  release 
the  latest  Hungarian  research,  even  though  it  may  already 
have  been  submitted  to  a Western  journal,  as  I observed 
this  phenomenon  at  the  Mathematical  Institute.  From  his 
questions  and  comments  on  my  own  talk  at  his  Institute  concerning 
the  output  signal  and  noise  from  a nonlinearity,  I nevertheless 
gained  the  impression  that  Csibi 's  interests  are  very  broad. 

Wire-Conmunication  Department.  Each  of  the  six  Departments 
in  Csibi 's  Institute  has  a staff  of  the  order  of  a dozen 
or  15  and  is  headed  by  an  associate  professor.  Dr.  Geza 
Gordos  is  in  charge  of  the  Department  of  Wire  Communication 
and  Data  Processing.  He  got  his  telecommunicatons  diploma 
from  the  Technical  University  of  Budapest  in  1960,  specializing 
in  filters,  auid  he  then  went  to  work  for  the  Post  Office 
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Rese2urch  Institute,  where  Denis  Glbx>r  and  George  von  Bekesy 
had  once  worked.  It  was  there  that  Gordos  became  interested 
in  signal -ctnd-noise  problems.  He  also  developed  an  Improved 
approach  to  the  loading  of  frequency-divison-raultiplex  (FDM) 
relays  as  used,  for  example,  in  the  USSR,  where  many  different 
channels  may  be  carrying  the  same  facsimile  signal  (an  on- 
off-keyed  tone)  to  different  towns  for  use  in  producing 
their  local  newspapers.  The  usual  approach  to  loading 
based  on  independent  signals  in  the  channels  would  not  be 
applicable;  it  would  lead  to  overloading  and,  hence  to  dis- 
tortion. 

Although  now  teaching  at  the  Technical  University, 

Gordos  is  a consultant  to  Budavox,  a Hungariem  telephone 
manufacturer,  for  whom  he  was  to  travel  to  Pushchino,  USSR, 
to  discuss  his  work  on  the  loading  of  telephone  multiplex 
equipment.  For  the  Budavox  Company  Gordos  had  developed 
a generator  of  a random  waveform  resembling  human  speech 
not  only  in  its  spectrum  but  also  in  its  probability  density 
function.  For  this  purpose  the  noise  generator  includes 
a piecowise-linear  circuit  as  well  as  a filter,  and  account 
is  taken  of  its  effect  on  the  output  spectrum. 

The  USSR  is  buying  all  of  the  telephone  equipanent 
it  cem  get  from  Budavox,  and  it  is  even  offering  to  finance 
plant  expansion.  The  USSR's  telephone  needs  are  so  great 
that  it  is  procuring  equipment  wherever  it  be  obtained, 
e.g.,  from  the  Nokia  Company  in  Finland  and  Plessey  in  Engleuid. 
Gordos  h^ls  spent  some  time  in  Englcmd  on  two  different  occasions 
(Imperial  College  in  1975  and  Salford  Univ.  in  1974)  and 
also  Japan  (in  July  1977) . He  would  like  to  visit  the  US 
if  an  invitation  should  be  extended  to  him. 

Gordos  has  written  two  books  on  filters  based  on 
his  former  teachers'  lectures  and  a 207-page  book  on  statistical 
ccaanunication  theory  published  in  1969,  all  in  Hungarian. 

He  has  translated  the  1968  book  FrinoipleB  of  Data  Cormnmiaation , 
by  Lucky,  Salz,  and  Weldon,  into  Hungarian,  and  in  1971 
he  wrote  an  often  reprinted  book  on  data  trcmsmission  auid 
data  processing  (DP)  with  chapters  on  information  theory, 
coding,  statistical  connunication  theory,  digital  transmission, 

OP  hardware,  and  DP  software,  the  penultimate  chapter  having 
been  written  by  Vaurga  Andras. 

Gordos  has  contributed  chapters  on  communication 
theory  and  on  information  theory  to  various  books,  .and 
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one  of  these  led  to  a project,  now  terminated,  apparently 
without  much  success,  that  sought  to  categorize  babies' 
cries  automatically  into  "dirty,"  "hungry,"  "angry,"  and 
"vocalizing."  A related  project,  carried  out  by  his  students 
with  the  aid  of  a PDP-11  computer,  attei^ted  to  distinguish 
between  identical  and  fraternal  twins  by  analysis  of  records 
of  their  voices.  Twins  between  the  ages  16  euid  60  %*ere 
recorded  «diile  reading  the  same  newspaper,  amd  it  was  found 
that  the  identical  twins  could  be  distinguished  by  the  silences 
preceding  their  explosive  sounds,  which  are  evidently  hereditary. 
Gordos  feels  that  the  phase  spectrum  may  be  determinative 
for  this  identification  problem. 

Computing  Facilities.  The  Technical  University 
seems  to  be  well  supplied  with  computers,  there  being  an 
R-5  euid  an  R-10  made  in  Hungary  located  in  Csibi's  Institute. 
Elseidiere  on  the  canpus  is  an  IBM  370-115,  installed  in 
May  1977,  that  is  to  be  equipped  with  three  time-sharing 
terminals.  There  is  also  a 12-year-old  transistorized 
(discrete-conqponent)  Razdan  coiq>uter  from  Armenia,  and 
there  is  R-32  (resmbling  an  IBM  360)  that  was  produced 
in  Poland.  I was  not  able  to  see  emy  of  these  auichines 
because  of  the  brevity  of  my  visit  to  the  Technical  University, 
tdiich  was  hastily  2urranged  as  a result  of  my  talk  (on  the 
output  signal  and  noise  from  a nonlinearity)  at  the  Math- 
ematical Institute  so  that  I might  present  a similar  talk 
to  a more  appropriate  audience. 

Other  Institutions 

In  connection  with  the  Telecommunications  Research 
Institute  (TKI) , I have  already  mentioned  Katona  and  Csibi, 
idio  worked  there  in  tlie  past.  Mhile  visiting  the  Technical 
University  I met  Andras  Baranyl,  who  is  currently  %rorking 
at  the  TKI.  His  current  interest  is  in  the  effect  of 
two  nonlinearities  separated  by  a filter  upon  an  FM  waveform. 

The  filter  removes  a leurge  part  of  the  harmonics  produced 
in  the  first  nonlinearity  (e.g.,  an  amplifier  delivering 
the  greatest  possible  fundamental  output  power) , and  the 
second  one  might  be  designed  to  remove  the  remainder  of 
the  contaminating  harmonicr.  However,  Baranyl  finds  that 
the  delay  introduced  by  the  filter  makes  it  impossible  to 
do  this  by  means  of  a memoryless  nonlinearity.  Possibly 
this  problem  arising  in  FDM-FM  microwave  telephone  relaying 
might  better  be  attributed  to  the  filter'e  shifting  the 
phases  of  the  harmonics  so  that  the  resulting  waveform 
cannot  be  regarded  as  having  been  produced  by  a memoryless 
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nonlinecurity,  and  hence  there  is  no  inverse  nonlinearity 
that  will  undo  its  effect. 

While  visiting  the  Mathematical  Institute,  I met  some 
people  from  other  organizations,  among  them  Dr.  Ivan  Schmideg 
from  the  Fine  Mechanical  Nbrks  IFMV)  etnd  Dr.  J^zsef  Denes 
of  the  Coordination  Institute  for  Computing  Techniques 
in  Budapest.  Denes' s paper  on  groupoids  and  codes  is  included 
in  the  proceedings  of  the  1975  Keszthely  Colloquium  mentioned 
eaurlier.  Along  with  A.D.  Keedwell  he  is  the  author  of  a 
book  on  Latin  Squares  and  their  Applioatone  published  in 
1974  by  the  Academic  Press,  idiich  is  apparently  now  out 
of  print  except  in  Hungary)  there  it  is  available  at  the 
bookstore  of  the  Hungarian  Academy  of  Sciences  on  Vaci  Utca, 
Budapest,  for  320  forints. 

Another  book  that  may  be  mentioned  in  connection 
with  information  theory  in  Hungary  is  On  Measures  of  Information 
and  their  Characterizations,  by  J.  Aczel  (University  of 
Waterloo,  Ontario)  and  Z.  Daroczy  (Math.  Dep't.,  Kossuth 
Univ.,  Debrecen,  Hungary),  published  in  1975  by  the  Academic 
Press,  A review  by  Csiszar  of  this  book  appears  in  the 
Novenber  1976  IEEE  Trans,  Inform,  Theory  (pp.  765-766) . 

Daroczy' s primary  interest,  however,  appears  to  lie  in  the 
functional  equations  arising  in  this  connection  rather  than 
in  information  theory  and  its  applications. 

Although  Schmideg 's  present  task  is  the  simulation 
of  the  heat  flow  in  a ceibinet  containing  a microwave  transmitter, 

I was  particularly  glad  to  meet  him,  as  I had  made  use  of 
his  "Note  on  the  Evaluation  of  Fourier  Coefficients  of  Power- 
Law  Devices"  [Proa,  IEEE  5^  (Aug.  1968) , 1383-1384]  in  determining 
v4iat  nonlinearity  will  have  a prescribed  effect  on  any  given 
harmonic  of  a sinusoid,  as  a function  of  the  amplitude  of 
its  input  [IEEE  Trans,  Inform,  Theory  IT-17,  398-404  (July 
1971)].  This  work  represents  a part  of  Schmideg 's  doctoral 
dissertation,  which  has  apparently  not  found  other  application 
apart  from  his  papers  "The  Effects  of  Limiting  on  Angle- 
an<i  Amplitude-Modulated  Signal"  [Proa,  IEEE  57,  1302-1303 
(July  1969)]  and  "Harmonic  Synchronization  of  Nonlinear 
Oscillators"  [Proa,  IEEE  59,  1250-1251  (Aug  1971] . In  1968 
and  1969  Schmideg  was  employed  by  the  Microwave  Laboratory 
of  the  Orion  Radio  and  TV  Works  in  Budapest,  but  by  1971 
he  was  with  the  Institute  for  Electric  Power  Research,  Budapest. 

One  result  found  in  his  thesis  that  he  has  still 
not  published  but  which  may  be  useful  is  the  following. 
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For  the  mplitude  V (a)  of  the  mth-hemnonic  output  of  a 
memoryless  nonlinearity  with  a sinusoidal  input  of  aoqplitude  a, 
we  have 
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tdiere  K is  an  integer  calculated  from  the  X coefficients 
in  SchnffaSg's  1968  paper,  £md  i is  0 or  1 accordingly  as  m 
is  even  or  odd. 


It  may  be  mentioned  that  Hungary  has  two  television 
networks,  but  people  living  near  the  Austrian  border  axe 
able  to  receive  TV  from  outside  the  curtain,  which  is  there 
relatively  transparent.  In  Eastern  Europe  the  band  from 
63  to  74  MHz  was  selected  instead  of  frequencies  above  88  MHz 
for  PM  broadcasting,  but  this  effort  at  isolation  has  had 
very  little  effect,  as  the  medium-wave  band  (550-1600  kHz) 
eeisily  carries  programs  across  borders,  especially  at  night, 
and  short-w^n^e  receivers  £ure  not  uncommon. 


When  officially  invited,  visitors  are  very  warmly 
welccmed  in  Hungary,  tdiere  they  find  no  difficulty  communicating 
in  English  with  fellow  research  scientists  and  engineers. 

In  many  but  not  all  other  cases,  however,  the  ability  to 

^eak  German  can  be  very  useful.  Some  Hungeurians  seem 

much  braver  than  others  about  showing  sympathy  toward  representatives 

of  Western  governnents,  and  so  the  visitor  will  find  himself 

described  as  coming  from  a nongovernmental  institution  if 

his  Hungarian  hosts  can  possibly  manage  to  do  so.  While 

the  visitor  should  not  conceal  his  affiliations,  he  should 

avoid  esdsarrassing  people  by  bringing  them  up  unnecessaurily. 

Despite  many  difficulties,  however,  Hungary  seems  to  be 
keeping  abreast  of  research  in  the  rest  of  the  world. 


